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METHODS AND APPARATUS FOR PROVIDING AGENT CONTROLLED 
SYNCHRONIZED BROWSING AT A TERMINAL 

§ 0 . RELATED APPLICATIONS 

Benefit is claimed, under 35 U.S.C. § 119(e)(1), 
to the filing date of provisional patent application serial 
5 no. 60/151,793, entitled "Interactive Multimedia System for 
Use with Kiosks and Internet Based Customers", filed on 
August 31, 1999 and listing M. Reza Shafiee and Sankar 
Subramanian as inventors, for any inventions disclosed in 
the manner provided by 35 U.S.C. § 112, ^ 1. This 
10 provisional patent application is expressly incorporated 
herein by reference. 

§ 1, BACKGROUND OF THE INVENTION 

15 § 1.1 FIELD OF THE INVENTION 

The present invention concerns methods and 
apparatus for providing agent controlled (e.g., secure) 
synchronized (e.g., web) browsing at a terminal. More 

20 specifically, the present invention concerns methods and 
apparatus for permitting a live agent to assist a customer 
at a terminal, such as a kiosk for example, by navigating 
through content, such as hyper- text markup language (or 
''HTML") pages for example, which is rendered at both the 

25 customer terminal and the agent's station. 

Express Mail No.: EL404084934US 
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§ 1»2 RELATED ART 

Below, methods for providing customer service, as 
5 well as perceived shortcomings of such methods, are 
introduced. Internet -based customer service and its 
perceived shortcomings are introduced in § 1.2.1 below. 
Then, a system in which customers can access live agents 
from kiosks is introduced in § 1.2.2. Finally, known 
10 synchronized web browsing techniques are introduced in § 
1.2.3. The discussion of these systems in this section is 
not, and should not be interpreted as, an admission that 
such systems are prior art . 

15 § 1.2.1 INTERNET -BASED CUSTOMER SERVICE 

The Internet has been successfully used to reduce 
the need for human customer service representatives. That 
is, in many instances, customers can use the Internet to 

20 answer questions that they would otherwise present to a 

human customer service representative (also referred to as 
a "live agent"). However, the present inventors believe 
that in may instances, customers still would like to confer 
(e.g., talk) with a live agent. The kiosk system discussed 

25 in § 1.2.2 below permits a customer at a kiosk to establish 
an audio, video, and/or text message conference or "call" 
with a live agent. The present invention uses the kiosk 
system of § 1.2.2 below to permit the live agent to 
navigate through content, such as HTML pages for example, 

30 which is rendered at both the customer terminal and the 
agent's station. 
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§ 1.2.2 KIOSK SYSTEM 

Provisional patent application serial no. 
60/151,793, entitled "Interactive Multimedia System for Use 
5 with Kiosks and Internet Based Customers'\ and filed on 
August 31, 1999, discloses a multimedia call center (or 
"MCC"') in which live agents can assist customer end users 
at kiosk stations. It is expected that such kiosks will be 
located in areas open to the public, and preferably areas 

10 with high traffic such as airports, malls, grocery stores, 
train stations, bus terminals, etc. In such a system, a 
live agent can help a customer or potential customer 
complete a transaction. This system may be used to 
establish an audio, video, and/or text message conference 

15 or "call" with a live agent as is described in the 
provisional application and in § 4.2.1 below for the 
reader's convenience. The present invention may use this 
system to permit the live agent to navigate through 
content, such as HTML pages for example, which is rendered 

20 at both the customer terminal and the agent's station. 

§ 1.2.3 KNOWN SYNCHRONIZED WEB BROWSING 
TECHNIQUES 

25 Synchronized web browsing may be effected between 

a ^^guide" terminal (i.e., a terminal that navigates through 
content) and a "follower'^ terminal (i.e., a terminal upon 
which content retrieved (or requested) by the guide 
terminal may be rendered) . Typically, the guide terminal 

30 will download a synchronized web browsing applet to the 
follower terminal. This applet is executed by a web 
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browser, at the follower terminal, to establish a 
synchronized web browsing session. 

Most web browsers, such as Explorer from 
5 Microsoft Corporation and Navigator from Netscape 

Corporation for example, have an optional setting in which 
applets, which may have been downloaded, are not 
automatically executed without the user's permission. This 
option permits the user to avoid malicious 'Virus" applets 

10 which may be used to steal personal or confidential 

information from the user's computer, destroy data at the 
user's computer, or perform some other type of malicious 
act using the user's computer. In the context of a kiosk 
system, security concerns led the present inventors to 

15 construct an exemplary browsing process in which no 
downloaded applets would be executed via the browser. 
Thus, a goal of the present invention is to establish and 
facilitate a synchronized (web) browsing session between an 
agent (guide) and a customer (follower) without downloading 

20 an applet for synchronized (web) browsing. 

§ 2. SUMMARY OF THE INVENTION 

The present invention discloses methods, 
25 apparatus and data structures which may be used to 

establish and facilitate a synchronized web browsing 
session between an agent (guide) and a customer (follower) 
without downloading an applet for synchronized (web) 
browsing. Communications between the agent and the 
30 customer related to synchronized browsing may be encrypted. 
The encryption may be based on information provided from a 
session manager when a call between the agent and the 
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customer is established. The kiosk and/or agent station 
may control access to content based on locators to the 
content (e.g., URLs) . The access control may be based on 
GO, NO GO lists and/or rules. 

5 

§ 3 . BRIEF DESCRIPTION OF THE DRAWINGS 

Figure 1 is a high level block diagram of a 
system which may be used to effect at least some aspects of 
10 the present invention. 

Figure 2 is a high level block diagram of an 
architecture which may be used by various components of the 
system of Figure 1. 

15 

Figure 3 is a block diagram of an exemplary 
session manager which may be used to effect at least some 
aspects of the present invention. 

20 Figures 4 through 7 are exemplary database 

records which may be used to effect at least some aspects 
of the present invention. 

Figures 8 through 10 are exemplary memory tables 
25 which may be used to effect at least some aspects of the 
present invention . 

Figure 11 is a flow diagram of an exemplary 
method for logging in kiosks and/or agent stations in a 
30 system, such as the system of Figure 1. 
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Figure 12 is a messaging diagram of 
communications which may occur in an exemplary method for 
logging in kiosks and/or agent stations in a system, such 
as the system of Figure 1. 

5 

Figure 13 is a flow diagram of an exemplary 
method for setting up a call between a kiosk and an agent 
station in a system, such as the system of Figure 1. 

10 Figure 14 is a flow diagram of an exemplary 

method for selecting an appropriate agent in response to a 
call request by a kiosk in a system, such as the system of 
Figure 1 . 

15 Figure 15 is a messaging diagram of 

communications which may occur in an exemplary method for 
setting up a call between a kiosk and an agent station in a 
system, such as the system of Figure 1 . 

20 Figure 16 is an exemplary data structure of a 

call queue. 

Figure 17 illustrates a time out process for 
selecting a live agent based on their skills. 

25 

Figure 18 is a flow diagram of an exemplary 
method for operating a multimedia session manager in a 
system, such as the system of Figure 1. 

30 Figure 19 is a messaging diagram of 

communications which may occur in an exemplary method for 
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establishing and effecting a (secure) synchronized browsing 
session between a customer and a live agent. 

Figure 2 0 is a flow diagram of an exemplary 
5 method for operating a kiosk in a system, such as the 
system of Figure 1, 

Figure 21 is a flow diagram of an exemplary 
method for controlling access to content. 

10 

Figure 22 illustrates exemplary and simplified 
"NO GO" and ''GO" lists and rules which may be used by the 
exemplary method of Figure 21. 

15 Figure 23 is a Venn diagram which illustrates a 

possible operation of the access control method of Figure 
21. 

Figure 24 is a Venn diagram of known content 

20 filters. 

Figure 2 5 is a flow diagram of an exemplary 
method for operating an agent station in a system, such as 
the system of Figure 1 . 

25 

§ 4. DETAILED DESCRIPTION 

The present invention involves novel methods, 
apparatus and data structures for providing agent 
30 controlled synchronized browsing at a terminal. The 

following description is presented to enable one skilled in 
the art to make and use the invention, and is provided in 
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the context of particular applications and their 
requirements. Various modifications to the disclosed 
embodiments will be apparent to those skilled in the art, 
and the general principles set forth below may be applied 
5 to other embodiments and applications. Thus, the present 
invention is not intended to be limited to the embodiments 
shown and the inventors regard their invention as the 
following disclosed methods, apparatus and data structures 
and any other patentable subject matter to the extent that 
10 they are patentable. 

In the following, functions which may be 
performed by the present invention are introduced in § 4 . 1 
Then, structures, processes, methods and data structures 
15 which may be used to effect those functions are described 
in § 4.2. Finally, an example of how an exemplary system 
of the present invention may operate is described in § 4.3 

§ 4.1 FUNCTIONS WHICH MAY BE PERFORMED 

20 

At a high level, the present invention may 
function to providing agent controlled synchronized 
browsing at a terminal. This may be done without 
downloading an applet for synchronized browsing to the 

25 terminal, or at least without downloading such an applet 
from a guide terminal. The present invention may also be 
used to establish a secure channel over which synchronized 
browsing commands and acknowledge messages may be 
communicated between an agent at an agent terminal and a 

30 customer at a terminal, such as a kiosk for example. The 
content to be browsed may include HTML pages for example. 
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Access to content may be controlled at both the agent 
terminal and the kiosk. 

§ 4.2 STRUCTURES, PROCESSES, METHODS AND DATA 

5 STRUCTURES 

An overview of a system which may be used to 
effect various aspects of the present invention is provided 
in § 4.2.1 below. Then, exemplary embodiments of various 
10 components of the system are described in more detail in §§ 
4.2.1.1 through 4.2.1.4 below. Finally, an example which 
illustrates an operation of the exemplary system is 
provided in § 4.3 below. 

15 § 4.2.1 SYSTEM OVERVIEW 

Figure 1 is an exemplary system 100 which may be 
used to effect at least some of the functions introduced 
above. The system 100 may include one or more kiosks 110, 

20 one or more web site servers 190, one or more agent 

stations 130, and a multimedia call center server 160. 
Each of these components may communicate with one another 
via network (s) 180, such as the Internet, public 
network(s), and/or private network(s) for example. Each 

25 component of this exemplary system 100 is described in more 
detail below. 

A kiosk 110 may function to permit a customer to 
interact with a live agent. Such customer-live agent 
30 interactions may take place via video, audio and/or data 
(such as text messages for example) communications. The 
live agent can control the kiosk 110 to display information 
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to the customer via a web browser and/or a display device. 
The kiosk 110 may also function to invoke the establishment 
of a connection between it and an agent station 130. 
Further, the kiosk 110 may function to encrypt (using a 

5 public key for example) communications sent from it. 

Furthermore, the kiosk 110 may function to control access 
to content, such as web pages for example. Referring to 
Figure 2, these functions may be effected by a processor (s) 
210, a storage device (s) 230 (such as RAM, ROM, magnetic, 

10 optical, and/or magneto-optic disks, and magnetic tape for 
example), input/output interfaces 220, an input device(s) 
250 (such as a keyboard, a keypad, a pointing device, a 
microphone, a card reader, a signature capture device, a 
scanner, such as a flatbed scanner for example, a touch 

15 screen and/or a video camera for example) , an output 

device (s) 260 (such as a video monitor, a printer, a check 
printer and/or a speaker (s) for example), and a system bus 
or network 24 0. The processor (s) 210, input /output 
interface (s) 220, and storage device (s) 230 may communicate 

20 with one another via the system bus or network 240, Thus, 
for example, the functions which may be performed by the 
customer terminal may be effected by a personal computer. 
An exemplary customer terminal (e.g., a kiosk 110) is 
described in more detail later, in § 4.2.1.2. 

25 

A web site server 190 may function to serve 
requested web pages or other content to customers at kiosks 
110 and/or agents at agent stations 130. This and other 
functions, which may be performed by the web site server 
30 190, may be effected by the devices discussed above with 
reference to Figure 2 . 



10 



Bell- 17 



The agent stations 13 0 may function to permit a 
live agent to assist a customer at a kiosk 110. Such 
assistance may take the form of audio, video, and/or data 
(e.g.; text messages) communications, as well as 
5 synchronized (web) browsing in which the agent station 13 0 
acts as a guide terminal and the kiosk 110 acts as a 
follower terminal. The agent station 130 may also function 
to invoke the establishment of a connection between it and 
another terminal, such as a kiosk 110 or another agent 

10 station 130. Further, the agent station 130 may function 
to encrypt (using a public key for example) communications 
sent from it. Furthermore, the agent station 130 may 
function to control access to content, such as web pages 
for example. An agent station 13 0 may further function to 

15 permit a live agent to control kiosk peripherals, access 
customer information from a database 168, update customer 
information, send and receive messages from other live 
agents, invoke the transfer of a customer to another live 
agent, and access call information. These functions, which 

20 may be performed by the agent station 13 0, may be effected 
by the devices discussed above with reference to Figure 2. 
In an exemplary embodiment, agent stations 13 0 may include 
a web (e.g., HTML) browser which is similar to the web 
browser included in the kiosk stations. An exemplary agent 

25 station 130 is described in more detail later, in § 
4.2.1.3. 

The web browsers in both a kiosk 110 and an agent 
station 13 0 can be synchronized so that the same content is 
30 rendered at, or the same content can be requested by, both 
the kiosk 110 and the agent station 13 0 at about the same 
time. The live agent operating the agent station 130 can 
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enable and/or disable the synchronized web browsing 
feature . 

In view of the foregoing, a live agent can view 

5 scanned identification documents, interpret them; and 

manually enter name, address and other information obtained 
from the identification documents into one or more forms, 
e.g., credit applications, purchase forms, etc. Since 
communication between the kiosk 110 and the agent stations 

10 130 may be provided over a secure, e.g,, encrypted data 

channel, confidential information may be exchanged without 
fear of unauthorized interception. Thus, for example, 
completed application or purchase forms can be transmitted 
to a kiosk 110, a signature on the form captured, and 

15 payment received without security concerns. In addition, a 
live agent can control the printing of checks, money 
orders, etc. at the kiosk 110. Thus, for example, if a 
loan application is approved, the customer can be provided 
the money in the form of a check issued directly from the 

20 kiosk 110. Furthermore, a live agent can fill out service 
and/or purchase forms based on, e.g., customer information 
obtained via scanned identification documents, and control 
the kiosk 110 to print the completed form, A customer's 
signature on a completed form can be captured using the 

25 kiosk's signature capture device and the completed form 
with signature can be printed at the kiosk 110 as well as 
the agent station 130. The flat bed scanner can be used to 
acquire images of driver's licenses, credit cards and other 
forms of identification. 

30 

A multimedia call center server 150 may include 
an operation and administration system 162, a multimedia 
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session manager 170, and storage devices 166, 168. The 
operation and administration system 162 may function to (i) 
monitor the system 100, (ii) check the status of any entity 
of the system 100, (iii) add or change agent stations 130, 
5 kiosks 110 and services, (iv) generate reports of agents, 
system usage, etc., and (v) distribute system files to 
various terminals. The multimedia session manager 170 may 
function to (i) distribute requests for agents (also 
referred to simply as "calls'^ . (ii) set up conferences, 

10 (iii) set up (e.g., secure) synchronized web browsing 

sessions between agents at agent stations 13 0 and customers 
at kiosks 110, (iv) manage communications channels, (v) 
download and upload files, (vi) manage skill groups and 
private user groups, (vii) log in and update kiosks 110 or 

15 other system terminals, (viii) control the login of live 
agents, (ix) distribute calls to skill groups and agents, 
(x) create private user groups (or "PUGs")/ and (xi) create 
call usage records. The multimedia session manager 170 may 
include a call management process 172 (also referred to as 

20 a "multimedia call manager" or simply a ^^call manager") for 
setting up, modifying, and/or terminating calls between a 
live agent at an agent station 13 0 and a customer at a 
kiosk 110, as well as establishing a secure channel (using, 
e.g., a connection server process 178) over which messages 

25 and commands for effecting a synchronized web browsing 

session may be communicated. The call management process 
172 may access and update memory tables 166 in a shared 
storage device. The multimedia session manager 170 may 
also include a web user interface process 174 which may be 

30 used to facilitate the establishment of an audio and/or 
video conference (or some other type of communications, 
such as text messages for example) over the network 190. 
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Finally, the multimedia session manager 170 may include a 
data support services process 176 which may access and 
update database files 168; which may include customer 
information for example, in a database. Each of the 
5 components of the multimedia call center server 160 may be 
hardware, processor (s) , storage devices, hardware and/or 
software interfaces, and/or software programs. An 
exemplary multimedia call center server 160 is described in 
more detail, later, in § 4.2.1.1. 

10 

Having introduced functions which may be 
performed by various components of the system 10 0 of Figure 
1, further details of the components are provided in §§ 
4.2.1.1 through 4.2.1,4 below. 

15 

§ 4.2.1.1 MULTIMEDIA CALL CENTER SERVER 



The multimedia call center server 160 is largely 
responsible for managing the system 100. It may function 

20 to control the distribution of calls, perform user 

validation, manage network resources, monitor station 
clients, and store and/or create call usage records. More 
specifically, the multimedia call center server 160 may be 
used to login stations, such as agent stations 13 0 and 

25 kiosks 110 for example, manage call requests from kiosks 
110, such as establishing a connection between a kiosk 110 
and an appropriate, available, live agent at an agent 
station 130, permit live agents to transfer a customer call 
to another live agent, permit a live agent to chat with 

30 another live agent, transfer files, manage information 
requests, maintain a list of live agents, cancel a call 
request from a kiosk 110, disconnect a call between a kiosk 
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110 and an agent station 130, and log out stations, such as 
agent stations 130 and kiosks 110. Exemplary methods and 
data flows for each of these functions are set forth in the 
provisional patent application serial no. 60/151,793, 

5 already incorporated herein by reference. Further, under 
the present invention, the multimedia call center server 
160, and in particular, a connection server process 178 of 
a call management process 172, may be used to facilitate 
the establishment of a secure channel between an agent 

10 station 130 and a kiosk 110 over which commands and 
messages for conducting a synchronized (web) browsing 
process may be communicated. This is typically done after 
a connection or call has already been established between 
the kiosk 110 and the agent station 130. Note that 

15 although the call may be an audio, video, and/or other data 
(such as text messaging for example) call, which may occur 
over a private or public network, the secure channel 
between an agent station 130 and a kiosk 110, over which 
commands and messages for conducting a synchronized web 

20 browsing process may be communicated, may be a public 
network, such as the Internet for example. 

An exemplary method for effecting the connection 
server process 178 is described in § 4.2.1.1.5 below. 

25 First, however, an exemplary architecture of a the 
multimedia call center server 160 is described in § 
4.2.1.1.1, exemplary database files and shared memory 
tables are described in §§ 4.2.1.1.2 and 4.2.1.1.3, 
respectively, below, and exemplary operation and 

30 administration system processes and architecture are 
described in § 4.2.1.1.4 below. 
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§ 4*2.1, 1-1 MULTIMEDIA CALL CENTER 
SERVER ARCHITECTURE 



The multimedia call center server 160 may be 
designed for use on a UNIX platform. The modules 162', 
164' and 170' may use shared memory and semaphores as 
supported by the operating system. The use of shared 
memory ensures data stability and ease of recovery. It 
also allows for data sharing between processes. 



The multimedia call center server 160 may include 
two (2) main components --a multimedia session manager 170 
and an operation and administration system 162. The 
session manager 170 is described in more detail in § 

15 4.2.1.1.5 below. The operation and administration system 
162 is described in more detail in § 4.2.1.1.4 below. As 
shown in Figure 3, the session manager 170 and the 
operation and administration system 162 may communicate 
with one another via a CDPE (Concurrent Distributed 

20 Processing Environment) layer 310. The entire system may 
sit atop a TCP/IP (Transmission Control Protocol/Internet 
Protocol) stack 320. 



§ 4.2,1.1.2 DATABASE FILES 

25 

Recall that user information may be stored, 
updated, and accessed by the operation and administration 
system 162, Figures 4 through 7 are exemplary data 
structures of files in the user information database 168. 
30 Figure 4 illustrates a directory database which contains a 
list of all stations (e.g., kiosks 110 and agent stations 
130) known to the session manager 170. The directory 
database is described in § 4.2.1.1.2.1 below. Figure 5 
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illustrates a skill database which contains a list of all 
skills of agents known to the session manager 170. The 
skill database is described in § 4.2.1.1.2.2 below. Figure 
6 illustrates a category database which contains a list of 
5 all category names known to the session manager 170. Since 
the category database is not particularly relevant to the 
synchronized (web) browsing aspect of the present 
invention, it is not described in further detail here. 
Finally, Figure 7 illustrates a private user group database 
10 which contains a list of all private user group names known 
to the session manager 170, Since the private user group 
database is not particularly relevant to the synchronized 
(web) browsing aspect of the present invention, it is not 
described in further detail here, 

15 

§ 4,2. 1. 1^2.1 DIRECTORY DATABASE 

The field names 410 of the directory database, as 
well as their size 420 and description 430, are set forth 
20 in Figure 4. Note that each kiosk 110 or agent station 130 
has a unique login name 440, an associated password 450, a 
unique port identifier 460, and a user name directory 
listing 470. Also note that the port identification 460 
may also be referred to as the "address" of the station. 

25 

§ 4.2.1.1.2.2 SKILL DATABASE 

The field names 510 of the skill database, as 
well as their size 520 and description 530, are set forth 
30 in Figure 5. The skill database stores primary video 
conferencing protocols 54 0 and addresses 545, secondary 
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video conferencing protocols 550 and addresses 555, and 
default video conferencing protocols 560 and addresses 565. 

§ 4 •2, 1.1. 3 SHARED MEMORY TABLES 

Memory tables are data structures that reside in 
shared memory 166. They are initialized upon startup of 
the call management process 172 and are accessible by the 
call management process 172. Having multiple instances of 
the call management process 172 permits data sharing. 
Figure 8 is a station table 800, Figure 9 is an active call 
table 900, and Figure 10 is a skill table 1000. Each is 
described in more detail below. 

A station table 800 contains information related 
to a station, such as a kiosk 110 or a agent station 130 
for example. The station table 800 illustrates field names 
810, and their type 820, size 830, and description 840. As 
shown in Figure 8, the station table 800 may include a 
login name 852 for the station, an associated password 854, 
a unique stations port identifier 856, a video conferencing 
protocol type identifier 862, a video conferencing address 
864, an alternative video conferencing protocol type 
identifier 866, an alternative video conferencing address 
868, an internet protocol (or "IP") address 870 of the 
station, an encryption type 882 employed by the station, 
and an (public) encryption key 884 disseminated by the 
station. 

The active call table 900 contains information 
related to an established call. Since the active call 
table 900 is not particularly relevant to the understanding 
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of the invention, it is not described in further detail. 
The skill table 1000 contains information related to the 
known skills. Since the skill table 1000 is not 
particularly relevant to the understanding of the 
5 invention, it is not described in further detail. 

^ § 4.2.1. 1.4 OPERATION AND 

ADMINISTRATION SYSTEM 
PROCESSES AND 
10 ARCHITECTURE 

The operation and administration system 162 may 
facilitate all administration-related tasks. These tasks 
may include generating reports, setting up resources, and 

15 managing the database 168. Recall from Figure 3 that the 
operation and administration system 162 may communicate 
with other components via the CDPE layer 310. Since the 
details of the operation and administration system 162 are 
not necessary for understanding the present invention, it 

20 is not described in further detail. 



§ 4.2.1.1.5 CALL MANAGEMENT AND 
CONNECTION SERVER 
PROCESSES 



25 



Before describing an exemplary method for 
effecting a connection server process 178 for establishing 
a synchronized (web) browsing session in § 4.2.1.1.5.3 
below, since such a method is typically effected after the 
30 kiosk 110 and agent station 130 are logged in and a call 
between the kiosk 110 and the agent station 130 has been 
established, exemplary methods of logging in stations and 
establishing calls, performed by the multimedia session 
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manager 170 and call manager 172' are first introduced in 
§§ 4.2.1.1,5.1 and 4.2.1.1.5.2 below. 

§ 4,2. 1.1. 5.1 STATION LOGIN 

The process of logging in a station is described 
with reference to both Figures 11 and 12. Figure 11 is a 
flow diagram of an exemplary method 1100 for logging in a 
station such as a kiosk 110 or an agent station 130. 
Figure 12 is a messaging diagram which illustrates 
communications between a station, such as an agent station 
130 or a kiosk 110, and the multimedia session manager 170 
in general. In response to a Station_Login_Request message 
1210, the method 1100 is invoked and the 

Station_Login__Request message 1210 is sent to the session 
manager 170 as shown in step 1110. The 

Station_Login_Request message 1210 may include a header, an 
address (recall unique port ID 460, 856 of the station), a 
station login identifier, an associated password, and a 
version of an application running on the station. The 
session manager 170 then checks the login name and password 
as shown in step 1120. If the login is not valid, the 
session manager 170 returns a Stat ion__Login_Response 
communication 1220 as shown in steps 1130 and 1140. This 
response 122 0 may include a header, a response code, an 
error code, a directory version, a configuration version, a 
multimedia version, an application version, and an attract 
loop version. If the login is valid, the session manager 
170 updates that station table 800 as shown in steps 1130 
and 1150 and returns a Station_Login_Response communication 
1220 as shown in step 1140. 
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As is further shown in Figure 12, the multimedia 
session manager 170 may further send an 

MSM_StationInf o_Request message to the station as shown in 
communication 1230. In response, the station may return an 
5 MSM^Stationlnf o_Response message to the multimedia session 
manager 170 as shown in communication 1240. The 
MSM_StationInfo_Response message 1240 may include a header, 
an address of the station, a response code, and error code, 
a video conferencing protocol, a video conferencing 
10 address, an alternative video conferencing protocol, an 
alternative video conferencing address, an IP address, a 
port number, and encryption type, and an (e.g., public) 
encryption key. 

15 As can be appreciated, using the login process, 

the multimedia session manager 170 now has access to 
information about all logged in kiosks 110 and agent 
stations 130. This information may stored in a station 
memory table 800 and used by the multimedia session manager 

20 170 to establish video conferences between the stations, as 
well as to allow the stations to exchange encrypted 
information . 

The process of establishing a call between two 
25 stations is described with reference to Figures 13 through 
17. Figures 13 and 14 are flow diagrams of exemplary 
methods 1300, 1400 for establishing a call to an agent 
station 130. Figure 15 is a messaging diagram which 
illustrates communications between a station, such as an 
30 agent station 130, a kiosk 110, and the multimedia session 
manager 170 for establishing a call. 
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Figure 13 is a flow diagram of an exemplary 
method, which may be carried out by the multimedia session 
manager 170 for example, for handling call requests, such 
as call requests received from kiosks 110 for example. 
5 Referring to both Figures 13 and 15, first, as shown in 
step 1310 and communication 1505, the multimedia session 
manager 170 receives a Station_Call_Request . This request 
may have been sent from a kiosk 110 as shown in Figure 15. 
The Station_Call_Request message may include a header and 

10 an address of the station. In response, memory table 166 
entries may be updated a shown in step 132 0 and the new 
call is placed into a call queue as shown in step 1330. 
Figure 16 illustrates an example of such a call queue 1600. 
The multimedia session manager 17 0 may then send out a 

15 Station_Call_Response message as shown in step 134 0 and 

communication 1510. This Station_Call_Response message may 
include a header, a response code, an error code, a 
position in the call queue, and a number of waiting calls. 
The number of waiting calls information may be made 

20 available to agents. This information may depend on a 
given agent's skill set(s), as well as a waiting time as 
will become apparent from a later discussion which refers 
to Figure 17. The method 1300 then ends as shown by node 
1350. However, referring to method 1400 of Figure 15, as 

25 well as Figure 15, the status of a message block is updated 
as shown in step 1410. 

Having described an example of how stations are 
logged in, an example of how station-to-station calls are 
30 established is described in § 4.2.1.1.5.2 below. Then, an 
exemplary method for effecting a connection server process 
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178 for establishing and maintaining a synchronized (web) 
browsing process will be described in § 4.2.1.1.5.3, 

§ 4.2,1,1.5.2 STATION TO STATION 
5 CALL SETUP 

Before the call establishment method of Figure 14 
and the messaging illustrated in Figure 15 are described 
further, the notion of skill groups and how skill groups 
10 affect call distribution is introduced. 

Each skill group represents a core skill that an 
agent may have. Skill groups have attributes such as skill 
name, primary timeout, secondary timeout, overflow timeout 

15 and fail-over information. (See, e.g., Figure 5.) These 
attributes may be used to tailor the call distribution 
process to the precise requirements of individual 
situations. Skill groups may be added, deleted and 
configured through the operation and administration system 

20 162. 

Service listings are "buttons" that appear on the 
screen of a kiosk 110. ("Used Car Loan" is an example of a 
service listing.) Each service listing requires the 
25 attention of an agent from a particular skill group. 

Service listings may be members of one or more private user 
groups (or ''PUGs") . Service listings may be' added, deleted 
and configured through the operation and administration 
system 162 . 

30 

Distinctions between service listing and skill 
group are illustrated in the following examples. Consider, 
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for example, that two buttons ^'New Car Loan" and '^Used 
Car Loan" are to appear on the kiosks 110. However, the 
same group of agents who specialize in "Car Loans" handles 
the calls related to both buttons. In this case, ^'New Car 
5 Loans" and "Used Car Loans" are service listings while "Car 
Loan" is a skill group. Further consider in this example, 
that in the Boston area, "Used Car Loans" are referred to 
as "Pre-owned Car Loans" . By combining the use of private 
user groups and service listings, a "Pre-owned Car Loan" 

10 button can be provided on kiosks 110 in the Boston area 
even though the same group of agents as above handles the 
calls. In the Philadelphia area, it may be desired to 
combine all "Loans" onto one "button" in the main screen of 
the kiosk 110. When the customer chooses the "Loans" 

15 button, it may be desired to present them with a secondary 
menu with, "New Car Loan", "Used Car Loan" and other loans. 
This too can be achieved very effectively using service 
listings . 

20 Having introduced the notions of skill groups and 

service listings, ways in which skill groups may affect 
call distribution is now introduced. When a customer at a 
kiosk 110 wishes to communicate with an agent (by touching 
a service button for example) , the kiosk 110 sends a 

25 request to the multimedia session manager 170 as described 
above. The multimedia session manager 170 tries to find an 
agent with the required skill as their primary skill to 
handle the call. If such an agent is not available, the 
call is held in a queue. Referring to Figure 17, during a 

30 primary timeout period (0-Tp) , the call is offered only to 
agents that have the required skill as their primary 
listing 1710. As time elapses (primary timeout (Tp) , 
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secondary timeout (Ts) ) , the call is progressively offered to 
agents that have the required skill as their secondary 172 0 
and overflow 1730 listing as well. The overflow skill 
group 173 0 may be a low- skill group that provides a backup 
5 answer mechanism. Agents in this group may therefore 

gather information from the caller that will be passed on 
to an agent with higher skills as soon as one becomes 
available . 

10 With these notions of skill groups, time out 

periods, and their affect on call distribution in mind, 
referring back to Figures 14 and 15 steps 1420, 143 0 and 
1450 perform the agent selection function illustrated in 
Figure 17. If no agent is assigned within a given period, 

15 the multimedia session manager sends an error 

MS]yi_CallStatus_Inf ormation message to the station that 
requested the call, as shown in steps 1430 and 1440 and 
communication 1515. This message 1515 may include a header 
and status information. In response, the kiosk may send an 

20 MSM_CallStatus_Response message as shown by communication 
1520. This message 1520 may include a header, an address 
of the kiosk 110, a response code, and an error code. 
Assuming, on the other hand, that an appropriate agent is 
available within one of the timeout periods, such an agent 

25 is assigned as shown in step 1470 and the multimedia 

session manager sends an iyiSM_Connect_Request message to the 
agent station 13 0 as shown in step 14 8 0 and communication 
1525. This message 1525 may include a header, a caller ID, 
a callee ID, a service ID, a video conferencing protocol, 

30 and a video conferencing address. Then, the multimedia 

session manager 170 sends a successful MSM_CallStatus_Inf o 
message to the kiosk 110 that requested the call as shown 
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in step 1490. This message may include information about 
the agent station 130 (such as IP address and public key 
for example) to which the call was assigned. 

5 At this point, since the agent station 130 has 

information (such as its IP address, the video conferencing 
protocol (s) it supports, etc.) about the calling station 
(such as a kiosk 110) , it sets up a call as shown in step 
1530, The agent station 130 can send an 

10 MSM__Connect_Response message back to the multimedia session 
manager 170 as shown by communication 1535. This message 
1535 may include a header, an address of the agent station 
13 0, a response code and an error code, and may be used to 
notify the multimedia session manager 170 that a connection 

15 is about to be started. The calling station (such as a 
kiosk for example) can send a 

Station_State_Indication (INCALL) message to the multimedia 
session manager 170 as shown in communication 1540. This 
message informs the session manager 17 0 that the caller 

20 station 110 has changed states and may include a header, an 
address of the calling station and a state. Other possible 
states include WRAP_UP, BREAK, PPCALLS, and READY. In 
response, the multimedia session manager may send a 
Station_State_Response message, as shown in communication 

25 1545 back to the caller station 110. This message may 

include a header, a response code, and an error code, and 
is basically an acknowledgement of the 
Station_State_Indication (INCALL) message 1540 . 

30 Now, the multimedia session manager 170 may 

provide station application manager (or ''SAM") address and 
encryption information to both the caller station (such as 
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a kiosk 110 for example) and the agent station 13 0 so that 
the customer at the caller station and an agent at the 
agent station 13 0 can communicate via the application 
managers. More specifically; the multimedia session 

5 manager 17 0 can send an MSM_SAiy[Receive_Request message to 
the caller station (such as a kiosk 110 for example) as 
shown in communication 1550, This message 1550 may include 
a header, an IP port address of the agent station 130, a 
port number, an encryption type and public key, and a 

10 category flag. Basically, this message informs the caller 
station that it needs to listen for a TCP/IP connection 
from the specified IP Address-Port Number, The encryption 
information permits the caller station to successfully 
communicate with the remote link. Thus, this encryption 

15 information may be used to secure a synchronized (web) 
browsing session between the agent station 13 0 and the 
kiosk 110, In response, the caller station (such as a 
kiosk 110 for example) may send an MSM_SAMReceive_Response 
message back to the multimedia call manager 170 as shown in 

20 communication 1555. This message 1555 may include a 

header, an address of the caller station, a response code, 
and an error code and basically acknowledges receipt of the 
MSM SAJy[Receive_Request message 1550 by the caller station. 
The multimedia session manager 170 can also send an 

25 MSM_SAMConnect_Request message to the agent station 13 0 as 
shown in communication 1560. Like the 

MSM_SAMReceive_Request message 1550, this message 1560 may 
include a header, an IP address, a port number, an 
encryption type and key, and a category flag. Similarly, 
30 this message basically informs the agent station 130 that 
it should make a TCP/IP connection to the specified IP 
Address -Port Number, The encryption information permits 
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the station to successfully communicate with the remote 
link. Thus, this encryption information may be used to 
secure a synchronized (web) browsing session between the 
agent station 130 and the kiosk 110. In response, the 
5 agent station may provide an MSM_SAMConnect_Response 

message as shown in communication 1565. This message may 
include a header, an address of the agent station, a 
response code and an error code and basically acknowledges 
receipt of the ]y[SM_SAMConnect_Request message 1550 by the 
10 agent station 130, 

Having described exemplary methods of logging in 
stations and establishing station to station calls, an 
exemplary method for establishing a synchronized (web) 
15 browsing session between an agent station 130 and a 

customer terminal station, such as a kiosk 110 for example, 
is described in § 4.2.1.1.5.3 below. 



20 



§ 4.2.1.1.5.3 CONNECTION SERVER 
(FOR SECURE 
SYNCHRONIZED WEB 
BROWSING) 



Figure 18 is a flow diagram of an exemplary 
25 method 178' for establishing a (secure) synchronized (web) 
browsing session between a customer terminal (such as a 
kiosk 110 for example) and an agent station 130. This 
method 178' illustrates steps that may be performed by the 
multimedia session manager 170. First, at decision branch 
30 point 1810, it is determined whether or not a synchronized 
(web) browsing request was received from an agent station 
130. If not, the method 178' branches to decision branch 
point 1850 (described later) . If so, the method 178' 
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branches to step 1820 which sends a request to the customer 
terminal (e.g., the kiosk 110). Typically, this kiosk 110 
may already have a call established with the agent station 
130. The multimedia session manager 170 then waits for an 
5 acknowledge response from the customer terminal (e.g., the 
kiosk 110) . Although not shown in Figure 18, if no 
acknowledge response is received from the customer terminal 
(e.g., the kiosk 110) within a predetermined period of 
time, the method 178' is left under a ^'timeout" condition. 

10 If, as shown in decision branch point 1830, it is 

determined that an acknowledge response was received from 
the customer terminal (e.g., the kiosk 110), then an 
acknowledge is sent to the agent station 13 0 which 
initially requested the synchronized (web) browsing session 

15 as shown in step 1840. Next, at decision branch point 

1850, it is determined whether or not an exit is commanded. 
If not, the method 178' continues to decision branch point 
1810. Otherwise, the method 178' is left via RETURN node 
1860. If the method 178' is event driven and invoked when 

20 a synchronized web browsing request is received, the method 
178' will not need the decision branch points 1810 and 
1850 , 

Referring to Figure 19, the method 178' is 
25 illustrated by the synchronized browsing request message 
1905 from the agent station 130 to the multimedia session 
manager 170, the request synchronized browsing request 
message 1910 from the multimedia session manager 170 to the 
kiosk 110, the acknowledge response message 1915 from the 
30 kiosk 110 to the multimedia session manager 170, and the 
acknowledge response message 192 0 from the multimedia 
session manager 170 to the agent station 130. 
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Having described the multimedia session manager, 
kiosk processes and architecture are now described in § 
4.2.1.2 below. Then, agent station processes and 
5 architecture are described in § 4.2.1.3 and web site server 
processes and architecture are described in § 4.2.1.4. 

§ 4.2.1.2 KIOSK PROCESSES AND ARCHITECTURE 

10 Recall from § 4,2.1 above that a kiosk 110 may 

function to permit a customer to interact with a live 
agent. Recall that such customer-live agent interactions 
may take place via video, audio and/or data (e.g., text 
messages) communications. The recall further that a live 

15 agent can control the kiosk 110 to display information to 

the customer via the (web) browser and display device. The 
kiosk 110 may also function to invoke the establishment of 
a connection between it and an agent station 130. Further, 
the kiosk 110 may function to encrypt (using a public key 

20 of the agent station 130 for example) communications sent 
from it. Furthermore, the kiosk 110 may function to 
control access to content, such as web pages for example. 

Referring back to Figure 2, recall that these 
25 functions may be effected by a processor (s) 210, a storage 
device (s) 230 (such as RAM, ROM, magnetic, optical, and/or 
magneto-optic disks, and magnetic tape for example) , 
input/output interfaces 220, an input device (s) 250 (such 
as a keyboard, a keypad, a pointing device, a microphone, a 
30 card reader, a signature capture device, a scanner, such as 
a flatbed scanner for example, a touch screen and/or a 
video camera for example), an output device (s) 260 (such as 
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a monitor, a printer, a check printer and/or a speaker (s) 
for example), and a system bus or network 240. The 
processor (s) 210, input/output interface (s) 220, and 
storage device (s) 230 may communicate with one another via 
5 the system bus or network 240. Thus, for example, the 

functions which may be performed by the customer terminal 
may be effected by a personal computer. 

Finally, and most importantly in terms of the 
10 present invention, recall that the (web) browsers in both a 
kiosk 110 and an agent station 130 can be synchronized so 
that the same information is displayed on, or the same URL 
can be addressed by, both the kiosk 110 and the agent 
station 130 at about the same time. The live agent 
15 operating the agent station 130 can enable and/or disable 
the synchronized (web) browsing feature. 

Figure 2 0 is a flow diagram of an exemplary 
method 120' which may be used to effect the kiosk (web) 

20 browsing process 120. At decision branch point 2005, it is 
determined whether or not a user (web) browsing command is 
received from the customer at the terminal. If so, an 
"effect command" process (described later) is invoked as 
shown in step 2010 and the method 120' continues to 

25 decision branch point 2015, Otherwise, if no user (web) 
browsing command is received from the customer at the 
terminal, then the method 120' proceeds directly to 
decision branch point 2015. 

30 At decision branch point 2015, it is determined 

whether or not a synchronized (web) browsing request is 
received (for example, from the multimedia session manager 



31 



Bell- 17 



170) . If so, an acknowledge message is returned (for 
example, to the multimedia session manager 170) as shown in 
step 2 020, and the method 120' proceeds to decision branch 
point 2025. Referring back to Figure 19, these steps are 
5 illustrated by messages 1910 and 1915. If, on the other 
hand, a synchronized web browsing request is not received, 
then the method 120' proceeds directly to decision branch 
point 2025. 

10 At decision branch point 2 025, it is determined 

whether or not a synchronized (web) browsing command is 
received (for example, from the agent station 13 0 that 
requested the synchronized web browsing session) . If so, 
an acknowledge reply may be encrypted (by encryption 

15 process 124) and returned to the agent station 130 as shown 
in step 2030 and the "effect command" process (described 
later) may be invoked as shown in step 2035. The method 
120' then continues to decision branch point 2040. 
Referring once again to decision branch point 2025, if a 

20 synchronized (web) browsing command is not received, then 
the method 12 0' continues directly to the decision branch 
point 2040. 

At decision branch point 2040,' it is determined 
25 whether any content (such as HTML web pages, audio streams, 
video streams, GIF images, JPEG images, etc, for example) 
has been received. If so, the content is rendered by the 
customer terminal as shown in step 2 045 and the method 12 0' 
proceeds to decision branch point 2050. Otherwise, the 
30 method 120' proceeds directly to decision branch point 
2050. 
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At decision branch point 2050, it is determined 
whether or not an exit browser command has been received. 
This command, most likely, will originate from the customer 
at the terminal, but may, conceivably, come from the 
5 multimedia session manager 170 or the agent station 130. 
If an exit browser command has been received, the method 
12 0' is left via RETURN node 2 055. Otherwise, the method 
120' branches to decision branch point 2005, already 
described above . 

10 

Recall that if a user command was received 
(decision branch point 2005) or if a synchronized (web) 
browsing command was received (decision branch point 2 025) , 
an "effect command" process was invoked. Figure 21 is a 

15 flow diagram of a portion of an exemplary method 2100' for 
effecting this effect command process. As will be 
apparent, this exemplary method 2100' also effects the 
access control process 12G using GO/NO GO lists and/or 
rules 128. As indicated by the dotted lines, the method 

20 210 0' may include additional steps which are not shown. 

Basically, the steps of the method 2100' which effect the 
access control process 126 are shown. 

At decision branch point 2105, it is determined 
25 whether or not content associated with a universal resource 
locator (or ^^URL") was requested. If so, the steps related 
to the access control aspect of the method 2100' are 
entered. More specifically, an access control status of 
the kiosk is initialized to GO in step 2110 and the method 
30 2100 continues to decision branch point 2115. (The status 
may be initialized to NO GO as will be explained below) . 
At decision branch point 2115, it is determined whether or 
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not the URL is a NO GO, based on the NO GO contents of the 
list (and/or rules) 128. If not, the method continues 
directly to decision branch point 2135 which is described 
later. If. on the other hand, the URL is a NO GO, then the 
kiosk's access control status is set to NO GO as shown in 
step 2120 and the method 2100 continues to decision branch 
point 2125. At decision branch point 2125, it is 
determined whether or not the URL is a GO, based on the GO 
contents of the list (and/or rules) 128. If so, the 
kiosk's access control status is changed back to GO, as 
shown in step 2130 and the method 2100 proceeds to decision 
branch point 2135. Otherwise, the method continues 
directly to decision branch point 2135. Note, as indicated 
by the dotted lines, other method steps, though not shown 
and not related to access control, may be performed before 
decision branch point 2135. 

At decision branch point 2135, it is determined 
whether or not the kiosk's access control status is a NO 
GO. If not, the command is effected as shown in step 2140 
and the method 2100 is left via RETURN node 2145. 
Otherwise, if the control access status is a NO GO, the 
method 2100 is left via RETURN node 2145 without effecting 
the command. 

As can be appreciated from the description of 
Figure 21, the method 2100 limits access to content. It is 
interesting to note that a URL can be on both a NO GO and a 
GO. This allows the access control to filter out a large 
amount of content, and then allow back a smaller selected 
group of content or specified content. This aspect of the 
present invention may be best understood with reference to 
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the exemplary GO/NO GO list (and/or rules) 128' of Figure 
22 and the Venn diagram of Figure 23. In the exemplary 
list/rule of Figure 22, any URL with an ''http:'' prefix or a 
".com" extension may be a NO GO. However, specified URLs 
5 or groups of URLs may be considered GO based on a list 

and/or rules. Referring to the Venn diagram of Figure 23, 
label 2310 denotes all content, label 2320 denotes NO GO 
content, label 2332 denotes specific GO content (e.g., 
listed), and label 2334 denotes groups of GO content (e.g., 

10 as defined by rules) . Thus, GO content can be a sub- set of 
NO GO content. Referring back to Figure 21, this is why 
the access control status can be changed back to GO from NO 
GO as shown in steps 2120, 2125 and 2130. Notice also from 
the Venn diagram that the NO GO content can be all, almost 

15 all, or not quite all of the content. Referring back to 
Figure 21, if steps 2110 and 2115 are removed, the kiosk's 
access control status is set to NO GO as a default. In 
this case, referring to Figure 23, the NO GO content 2320 
would coincide with all content 2310. 

20 

The access control process 126 of the web site 
server process 12 0 may be therefore be thought of as a 
filter. However, this filter operates differently from 
known filters. Figure 24 is a Venn diagram which 
25 illustrates known content filters. Basically these filters 
allow all content 2410 except for certain specific content 
2432 (e.g., a specified hate group web site) or certain 
types of content 2434 (e.g., words that may indicate that 
the web site contains pornographic materials) , 
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Although the access control was shown as being 
applied to requests for content attempting to go out from 
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the kiosk 110, the access control may be applied to content 
attempting to come into the kiosk 110, though the former 
technique is preferred. 

5 Although customer actions in the present 

invention have been described as taking place through a 
kiosk, other types of terminals may be used. Thus, the 
term kiosk, as used in this specification, is to be 
interpreted as including many possible types of terminals, 
10 such as a personal computer with an Internet connection for 
example . 

Having described an exemplary customer terminal 
110, an exemplary agent station 13 0 is described in § 
15 4.2.1.3 and an exemplary web site server 12 0 is described 
in § 4.2.1.4 below. 

§ 4.2,1.3 AGENT STATION PROCESSES AND 
ARCHITECTURE 

20 

Recall from § 4.2.1 above that the agent stations 
130 may function to permit a live agent to assist a 
customer at a kiosk 110. Recall further that such 
assistance may take the form of audio, video, and/or data 

25 (e.g., text message) communications, as well as 

synchronized (web) browsing in which the agent station 13 0 
acts as a guide terminal and the kiosk 110 acts as a 
follower terminal. The agent station 130 may also function 
to invoke the establishment of a connection between it and 

30 another terminal, such as a kiosk 110 or another agent 

station 130. Further, the agent station 130 may function 
to encrypt (using a public key for example) communications 



36 



Bell- 17 



sent from it. Furthermore, the agent station 130 may 
function to control access to content, such as web pages 
for example. An agent station 130 may further function to 
permit a live agent to control kiosk peripherals, access 
5 customer information from a database 168, update customer 
information, send and receive messages to and from other 
live agents, transfer customers to another live agent, and 
access call information. These functions, which may be 
performed by the agent station 13 0, may be effected by the 
10 devices discussed above with reference to Figure 2, In an 
exemplary embodiment, agent stations 13 0 may include a 
(web) (e.g., HTML) browser process 150 which is similar to 
the (web) browser process 120 included in the kiosks 110, 
as well as a synchronized (web) browsing process 140. 

15 

Recall that the (web) browsers in both a kiosk 
110 and an agent station 13 0 can be synchronized so that 
the same information is displayed on, or the same URL can 
be addressed by, both the kiosk 110 and the agent station 
20 130 at about the same time. The live agent operating the 
agent station 13 0 can enable and/or disable the 
synchronized (web) browsing feature. 

In view of the foregoing, a live agent can view 
25 scanned identification documents, interpret them, and 

manually enter name, address and other information obtained 
from the identification documents into one or more forms, 
e.g., credit applications, purchase forms, etc. Since 
communication between the kiosk 110 and the agent stations 
30 130 may be provided over a secure, e.g., encrypted data 

channel, confidential information may be exchanged without 
fear of unauthorized interception. Thus, for example, 



37 



Bell- 17 



completed application or purchase forms can be transmitted 
to a kiosk 110, a signature on the form captured, and 
payment received without security concerns. In addition, a 
live agent can control the printing of checks, money 
5 orders, etc. at the kiosk 110. Thus, for example, if a 
loan application is approved, the customer can be provided 
the money in the form of a check issued directly from the 
kiosk 110. Furthermore, a live agent can fill out service 
and/or purchase forms based on, e.g., customer information 

10 obtained via scanned identification documents, and control 
the kiosk 110 to print the completed form. A customer's 
signature on a completed form can be captured using the 
kiosk's signature capture device and the completed form 
with signature can be printed at the kiosk 110 as well as 

15 the agent station 130. The flat bed scanner can be used to 
acquire images of driver »s licenses, credit cards and other 
forms of identification. 

Figure 2 5 is a flow diagram of an exemplary 
20 method 150' which may be used to effect the synchronized 
(web) browsing process 140 of the agent station 130. 
Referring to Figure 25, at decision branch point 2505, it 
is determined whether or not a synchronized (web) browsing 
session is requested (by the agent at the agent station 
25 130) . If not, the method 150' branches to decision branch 
point 2580 (described later) , If, on the other hand, it is 
determined that a synchronized (web) browsing session was 
:^equested (e.g., by the live agent), the agent station 130 
forwards the request to the multimedia session manager 170 
30 as shown in step 2508, and the method 150' continues to 

decision branch point 2510. At decision branch point 2510, 
it is determined whether or not an acknowledge message was 
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received from the multimedia session manager 170. If not, 
the agent station continues to wait for the acknowledge as 
indicated by the branching back to decision branch point 
2510, Although not shown, a "time-out" feature may be 
5 provided so that if an acknowledge is not received within a 
predetermined amount of time, the method 150' is left or, 
alternatively, another request is sent. Referring back to 
Figure 19, these steps of the method 150' correspond to 
communications 1905 and 1920. 

10 

Assuming that an acknowledge is received from the 
multimedia session manager 170, the agent station 130 then 
sends an ''open synchronized browsing (or ''S_B") channel" 
request to the kiosk 110, and the method 150' continues to 

15 decision branch point 2520. At decision branch point 2520, 
it is determined whether or not an acknowledge message was 
received from the kiosk 110. If not, the agent station 
continues to wait for the acknowledge as indicated by the 
branching back to decision branch point 2520. Although not 

20 shown, a "time-out" feature may be provided so that if an 
acknowledge is not received within a predetermined amount 
of time, the method 150' is left or, alternatively, another 
''open S_B channel" request is sent. Referring back to 
Figure 19, these steps of the method 150' correspond to 

25 communications 1925 and 1930. Still referring to Figure 
19, the dashed lines denote that these communications are 
encrypted. For example, recall from communications 1550 
and 1560 of Figure 15 that the multimedia session manager 
170 can provide the agent station 130 and the kiosk 110 

30 with the other station's encryption method and public key. 
Alternatively, the encryption type and public encryption 
key of the other station could be provided from the 
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multimedia session manager 170 in communications 1910 and 
1920 of Figure 19. In another alternative, the stations 
can directly exchange encryption type and public key 
information in (unencrypted) communications 1925 and 1930 
5 of Figure 19. 

Referring once again to Figure 25, if an 
acknowledge is received from the kiosk 110, at this point, 
both the agent station 130 and the kiosk 110 are able to 

10 share a synchronized (web) browsing session and the method 
150' continues to decision branch point 2525. At decision 
branch point 2 525, it is determined whether or not an agent 
command is received. If so, steps corresponding to the 
access control process 156 and the encryption process 154 

15 of the (web) browsing process 140 are effected. More 

specifically, the method 150' branches to decision branch 
point 2 53 0 where it is determined whether or not a URL is 
requested. If not, the method 150' branches to decision 
branch point 2560 (described later) . If, on the other 

20 hand, a URL is requested, the access control process 156 of 
the agent station 130 is effected. For example, the access 
control status of the agent station 130 can be initialized 
to GO as shown in step 2535. Then, the method 150' 
continues to decision branch point where it is determined 

25 whether or not the URL is a ^^NO GO" . This determination 
can be based on lists and/or rules 158. If the URL is not 
a NO GO, the method 150' branches to decision branch point 
2560 (described below) . If , on the other hand, the URL is 
a NO GO, the agent station's access control status is set 

30 to NO GO as shown in step 2 545 and the method continues to 
decision branch point 2550. At decision branch point, it 
is determined whether or not the URL is a GO. This 
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determination can be based on lists and/or rules 158, If 
not, the method branches to decision branch point 2560. 
If, on the other hand, the URL is a GO, the agent station's 
access control status is set to GO as shown in step 2555 
5 and the method 150' continues to decision branch point 
2560. At decision branch point 2560, it is determined 
whether or not the access control status is a NO GO. If 
the access control status is a NO GO, then the method 150' 
branches to decision branch point 2570. If, on the other 

10 hand, the access control status is not a NO GO, then the 
command is forwarded to the web site server 190 and 
encrypted and forwarded to the kiosk 110 as shown in step 
2565. The method 150' then continues to decision branch 
point 2570. Referring back to Figure 19, these steps are 

15 depicted by communications 1935, 1940, 1945, 1950. Note 
that the dashed lines depicting communications 1935 and 
1940 may indicate that the communications are encrypted. 
The heavy lines depicting communications 1945 and 1950 may 
indicate unencrypted communications over a network, such as 

20 the Internet for example. The commands may include OPEN, 
CLOSE, GO TO URL, and SCROLL{position} . 

The foregoing access control may operate in a 
similar manner to the access control performed at the kiosk 
25 110 and described in § 4.2,1,2 above. However, the GO, NO 
lists and/or rules may be different at the kiosk 110 and 
the agent station 130. 

Referring once again to Figure 25, at decision 
30 branch point 2570, it is determined whether or not content 
is received. If so, the content is rendered as shown in 
step 2575 and the method 150' continues to decision branch 
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point 2580. Otherwise, the method 150' continues directly 
to decision branch point 2580. At decision branch point, 
it is determined whether the agent has commanded an exit 
from the synchronized web browsing method 150' . If not, 
5 the method 150' branches back up to decision branch point 
2 525. If, on the other hand, an exit command has been 
received from the agent, the agent station 13 0 sends a 
^^close synchronized browsing channel" request to the kiosk 
130 as shown in step 2585 and the method 150' continues to 

10 decision branch point 2590. At decision branch point 2590, 
it is determined whether or not an acknowledge message is 
received from the kiosk 110. If so, the method 150' is 
left via RETURN node 2 595. If not, the agent station 13 0 
continues to wait for the acknowledge message as shown by 

15 the branching back to decision branch point 2590. Although 
not shown, a "time-out" feature may be provided so that if 
an acknowledge is not received within a predetermined 
amount of time, the method 150' is left via RETURN node 
2595 (and an error message may be reported to the 

20 multimedia session manager 170) . Referring back to Figure 
19, step 2585 and decision branch point 2590 correspond to 
messages 1965 and 1970. The dashed lines of these messages 
may indicate that the communications are encrypted. 

25 Having described an exemplary multimedia session 

manager 170, an exemplary kiosk 110 and an exemplary agent 
station 13 0, an exemplary web site server is now discussed 
in § 4.2.1.4 below. 
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§ 4,2.1.4 WEB SITE SERVER PROCESSES AND 
ARCHITECTURE 

5 Recall that a web site server 190 may function to 

serve requested web pages or other content. Thus, many 
known and commercially available web site servers may be 
employed in the system 100. The web site server 190 may 
also function to maintain a history log of, and/or 
10 information entered during, a transaction (referred to 
simply as "transaction information") and perform other 
proprietary functions . 



§ 4.3 EXAMPLES OF OPERATION 

15 

§ 4.3.1 ESTABLISHING AN AUDIO/VIDEO CALL 



Station to station call (which may include audio, 
video and/or text communications) setup was described with 
20 reference to Figure 15 in § 4.2.1.1.5.2 above. 

§ 4.3.2 AGENT LEAD (SECURE) SYNCHRONIZED 
BROWSING 

25 An example of an operation of the present 

invention in a secure, synchronized (web) browsing session 
is now summarized with reference to Figure 19. In the 
following example, it is assumed that the relevant kiosk 
110 and agent station 13 0 have already logged in with the 

30 multimedia session manager 170 and that a call has already 
been established between a customer at the kiosk 110 and 
the agent at the agent station 130. Recall finally, that 
in one embodiment of the present invention, the agent at 
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the agent station controls the synchronized (web) browsing 
process and its initiation. The agent station 130, in 
response to an agent command, may sent a request for a 
synchronized web browsing to the multimedia session manager 
5 170 as shown by communication 1905. (Recall step 2508 of 
Figure 25.) In response, the multimedia session manager 
170 forwards a request message to the kiosk 110 as shown by 
communication 1910, (Recall steps 1810 and 1820 of Figure 
18.) In response, the kiosk 110 sends an acknowledge 

10 message back to the multimedia session manager 170 as shown 
by communication 1915, (Recall steps 2015 and 2020 of 
Figure 20.) In response to this acknowledge, the 
multimedia session manager 170 may then forward an 
acknowledge message to the agent station 13 0 that requested 

15 the synchronized web browsing. (Recall steps 183 0 and 1840 
of Figure 18.) Thus far, all of the communications may be 
unencrypted and may be sent over a public or a private 
network . 

20 The agent station 13 0 can then send an request to 

open a synchronized browsing channel message to the kiosk 
110 as shown by communication 1925. (Recall steps 2510 and 
2515 of Figure 25.) The kiosk 110 may then respond with an 
acknowledge message as shown by communication 1930. 

25 (Recall steps 2025 and 2030 of Figure 20.) During the 

(secure) synchronized browsing session, the agent station 
13 0 may send a number of command messages to the kiosk 110 
as shown by communications 1935 and the kiosk 110 may send 
an acknowledge message back to the agent station 13 0 as 

30 shown by communication 1940. (Recall step 2565 of Figure 
25 and step 2030 of Figure 20.) The commands may include 
OPEN, CLOSE, GO TO URL, and SCROLL{position} . If the agent 
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station 13 0 sends a command to GO TO a URL, the agent 
station 13 0 will request that URL as shown in communication 
1945, and the kiosk station will request that URL as shown 
in communication 1955. Recall that these requests may be 
5 subject to an access control process which may block 

requests to certain content or URLs. The web site server 
190 provides the requested URL to the agent station 13 0 and 
kiosk 110 as shown by communications 1950 and 1960, 
respectively. 

10 

Note that in this exemplary embodiment, the 
synchronized browsing command and acknowledges may be 
encrypted and sent over a public network, such as the 
Internet for example. However, the requests for URLs and 

15 the content returned are not encrypted. 

§ 4.4 CONCLUSIONS 

In view of the foregoing, the present invention 
20 may be used to establish a (secure) synchronized (web) 
browsing session between a customer at a first terminal 
(such as a kiosk 110 for example) and a live agent at an 
agent station 13 0. A session manager may be used to 
establish this session. The first terminal does not need 
25 to download an applet from the agent station. Typically, a 
call will have already been established between the 
customer and the live agent. The kiosk and/or the agent 
may control access to content based on locators to the 
content (e.g., URLs) , The access control may be based on 
30 GO, NO GO lists and/or rules. 
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WHAT IS CLAIMED IS: 



1 1. A method for establishing and effecting a secure 

2 synchronized browsing session between a guide terminal and 

3 a follower terminal, the method comprising steps of: 

4 a) providing address and encryption information 

5 corresponding to the follower terminal to the guide 

6 terminal ; 

7 b) encrypting, with the guide terminal and based on 

8 the encryption information corresponding to the 

9 follower terminal, a browsing command to generate an 

10 encrypted browsing command; 

11 c) sending the encrypted browsing command to the 

12 follower terminal; 

13 d) receiving, with the follower terminal, the 

14 encrypted browsing command; 

15 e) decrypting, with the follower terminal, the 

16 encrypted browsing command to generate a decrypted 

17 browsing command; and 

18 f) effecting, at the follower terminal, the decrypted 

19 browsing command. 

1 2. The method of claim 1, wherein the browsing command is 

2 a request for content associated with a uniform resource 

3 locator. 

1 3. The method of claim 2 further including steps of: 

2 g) determining, at the follower terminal, whether or 

3 not access is permitted to the content; and 

4 h) if it is determined that access is permitted to 

5 the content; then requesting the content and if it is 
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6 determined that access is not permitted to the 

7 content/ then not requesting the content. 

1 4. The method of claim 3 wherein the step of determining 

2 whether or not access is permitted is based on at least one 

3 of a list of GO and NO GO locations and rules for 

4 determining whether or not a locator is a GO or a NO GO. 

1 5. The method of claim 1 further comprising a step of: 

2 g) effecting, at the guide terminal, the browsing 

3 command. 

1 6. The method of claim 2 further comprising a step of: 

2 g) effecting, at the guide terminal, the browsing 

3 command . 

1 7. The method of claim 1 wherein the address and 

2 encryption information corresponding to the follower 

3 terminal are provided to the guide terminal via a session 

4 manager. 

1 8. The method of claim 1 further comprising a step of: 

2 g) providing address and encryption information 

3 corresponding to the guide terminal to the follower 

4 terminal . 

1 9. The method of claim 8 wherein the encryption 

2 information corresponding to the guide terminal includes a 

3 public key. 
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1 10. The method of claim 1 wherein the encryption 

2 information corresponding to the follower terminal includes 

3 a public key. 

1 11. A method for establishing and effecting a synchronized 

2 browsing session between a guide terminal and a follower 

3 terminal, the method comprising steps of: 

4 a) providing address information related to the 

5 follower terminal to the guide terminal; 

6 b) providing address information related to the guide 

7 terminal to the follower terminal; 

8 c) sending, from the guide terminal, a browsing 

9 command to the follower terminal; 

10 d) receiving, with the follower terminal, the 

11 browsing command; 

12 e) effecting, with a browser at the follower 

13 terminal, the received browsing command, 

14 wherein the browser at the follower terminal is 

15 resident on the follower terminal before any 

16 connection between the follower terminal and the guide 

17 terminal . 

1 12. The method of claim 11, wherein the browser at the 

2 follower terminal is maintained by a session manager. 

1 13 . A system for establishing and effecting a synchronized 

2 browsing session, the system comprising: 

3 a) a guide terminal, the guide terminal including 

4 i) a connection process for invoking the 

5 establishment of the synchronized browsing 

6 session, and 
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7 ii) a process for generating synchronized 

8 browsing commands; 

9 b) a follower terminal, the follower terminal 

10 including 

11 i) a connection process for facilitating the 

12 establishment of the synchronized browsing 

13 session, and 

14 ii) a process for receiving synchronized 

15 browsing commands and for effecting those 

16 synchronized browsing commands; 

17 c) a session manager, the session manager working 

18 with the connection process of the guide terminal and 

19 the connection process of the follower terminal to 

20 establish and maintain the synchronized browsing 

21 session; and 

22 d) at least one network for communicating data 

23 between the guide terminal, the follower terminal, and 

24 the session manager. 

1 14 . The system of claim 13 wherein the guide terminal 

2 further includes an encryption process for encrypting the 

3 generated synchronized browsing commands, 

4 wherein the session manager sends encryption 

5 information about the guide terminal to the follower 

6 terminal, and 

7 wherein the follower terminal further includes a 

8 decryption process for decrypting the encrypted 

9 synchronized browsing commands based on the encryption 

10 information sent by the session manager. 
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1 15. A method for providing assistance from a live agent at 

2 a first terminal to a customer at a second terminal, the 

3 method comprising steps of: 

4 a) establishing, in response to an input at the 

5 second terminal, a call between the customer at the 

6 second terminal and the live agent at the first 

7 terminal ; and 

8 b) establishing a synchronized browsing session 

9 between the customer at the second terminal and the 
10 live agent at the first terminal, 

1 16. The method of claim 15 wherein the call includes audio 

2 and video communications. 

1 17. The method of claim 15 wherein, the synchronized 

2 browsing session includes sending, from the first terminal 

3 to the second terminal, encrypted browsing commands. 

1 18. The method of claim 15 wherein the synchronized 

2 browsing session is established in response to a request 

3 from the first terminal . 

1 19. The method of claim 15 wherein at least a portion of 

2 the synchronized browsing session takes place during at 

3 least a portion of the call. 

1 20. A method for establishing a synchronized browsing 

2 session between a guide terminal and a follower terminal, 

3 the method comprising steps of: 

4 a) accepting a request for a synchronized browsing 

5 session from the guide terminal; 
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9 



6 



7 



8 



b) sending, in response to the acceptance of the 
request for a synchronized browsing session, a 
browsing request to the follower terminal; 

c) accepting an acknowledge response from the 



10 



follower terminal; and 



12 



11 



13 



d) sending, in response to the acceptance of the 
acknowledge response, an acknowledge response to the 
guide terminal . 



1 21. The method of claim 20 further comprising a step of 

2 providing encryption information about the follower 

3 terminal to the guide terminal . 

1 22. The method of claim 20 further comprising a step of 

2 providing encryption information about the guide terminal 

3 to the follower terminal. 

1 23. In a follower terminal, a method for effecting a 

2 synchronized browsing session with a guide terminal, the 

3 method comprising steps of: 

4 a) accepting a synchronized browsing command from the 

5 guide terminal ; 

6 b) sending an acknowledge reply to the guide terminal 

7 in response to the acceptance of the synchronized 

8 browsing command; 

9 c) determining whether access to content associated 

10 with the browsing command is permitted; and 

11 d) if it is determined that access to the content 

12 associated with the browsing command is permitted, 

13 then requesting the content associated with the 

14 browsing command. 
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1 24. The method of claim 23 wherein the synchronized 

2 browsing command accepted from the guide terminal is 

3 encrypted, the method further comprising a step of 

4 decrypting the encrypted synchronized browsing command. 

1 25. The method of claim 24 wherein the acknowledge reply 

2 is encrypted. 

1 26. The method of claim 23 wherein the step of determining 

2 whether access to content associated with the browsing 

3 command is permitted is based on at least one of a list of 

4 GO and NO GO content locators and rules for determining 

5 whether or not a content locator is a GO or a NO GO. 

1 27. The method of claim 23 wherein the step of determining 

2 whether access to content associated with the browsing 

3 command is permitted includes steps of 

4 i) determining whether or not the browsing 

5 command includes a resource locator that has a NO 

6 GO status based on at least one of first rules 

7 regarding resource locators and a first list of 

8 resource locators, 

9 ii) if it is determined that the browsing 

10 command includes a resource locator that has a NO 

11 GO status, then 

12 A) setting a status to NO GO, 

13 B) determining whether or not the browsing 

14 command includes a resource locator that has 

15 a GO status based on at least one of second 

16 rules regarding resource locators and a 

17 second list of resource locators, and 
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18 C) if it is determined that the browsing 

19 command includes a resource locator that has 

20 a GO status, then setting the status to GO, 

21 and 

22 iii) requesting the content associated with the 

23 browsing command if the status is GO, 

1 28. In a guide terminal, a method for effecting a 

2 synchronized browsing session with a follower terminal, the 

3 method comprising steps of: 

4 a) accepting a synchronized browsing command from an 

5 input device of the guide terminal; 

6 b) encrypting the synchronized browsing command based 

7 on encryption information associated with the follower 

8 terminal; and 

9 c) sending the encrypted synchronized browsing 
10 command to guide terminal . 

1 29. The method of claim 28 further comprising a step of: 

2 bl) determining whether or not access to content 

3 associated with the browsing command is permitted, 

4 wherein the steps of (b) encrypting the 

5 synchronized browsing command and (c) sending the 

6 synchronized browsing command are performed only if it is 

7 determined that access to content associated with the 

8 browsing command is permitted. 

1 30. The method of claim 2 9 wherein the step of determining 

2 whether access to content associated with the browsing 

3 command is permitted is based on at least one of a list of 

4 GO and NO GO content locators and rules for determining 

5 whether or not a content locator is a GO or a NO GO. 
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1 31. A method for determining whether access to content 

2 associated with a browsing command is permitted, the method 

3 comprising steps of 

4 a) determining whether or not the browsing command 

5 includes a resource locator that has a NO GO status 

6 based on at least one of first rules regarding 

7 resource locators and a first list of resource 

8 locators ; 

9 b) if it is determined that the browsing command 

10 includes a resource locator that has a NO GO status, 

11 then 

12 i) setting a status to NO GO, 

13 ii) determining whether or not the browsing 

14 command includes a resource locator that has a GO 

15 status based on at least one of second rules 

16 regarding resource locators and a second list of 

17 resource locators, and 

18 iii) if it is determined that the browsing 

19 command includes a resource locator that has a GO 

20 status, then setting the status to GO; and 

21 c) requesting the content associated with the 

22 browsing command if the status is GO. 

1 32. A computer- readable medium having stored thereon, a 

2 data structure, the data structure comprising: 

3 a) a first field including information corresponding 

4 to an address of a terminal of a system for providing 

5 live agent help to customers; 

6 b) a second field including information identifying 

7 at least one of a video conferencing type and a video 

8 conferencing address; and 
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9 c) a third field including information identifying at 

10 least one of an encryption type used by the terminal 

11 and an encryption key corresponding to the terminal.. 
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ABSTRACT 

Establishing a (secure) synchronized (web) 
browsing session between a customer at a first terminal 
(such as a kiosk for example) and a live agent at an agent 
station. A session manager may be used to establish this 
session. The first terminal does not need to download an 
applet from the agent station. Typically, a call will have 
already been established between the customer and the live 
agent. The kiosk and/or the agent may control access to 
content based on locators to the content (e.g., URLs). The 
access control may be based on GO, NO GO lists and/or 
rules . 
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